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44 


Abstract 


45 The 2010 Desert RATS field test utilized two Space Exploration Vehicles (prototype planetary 

46 rovers) and four crewmembers (2 per rover) to conduct a geologic traverse across northern 

47 Arizona while testing continuous and twice-per-day communications paired with operation 

48 modes of separating and exploring individually (Divide & Conquer) and exploring together 

49 (Lead & Follow), respectively. This report provides qualitative conclusions from the geologist 

50 crewmembers involved in this test as to how these modes of communications and operations 

51 affected our ability to conduct field geology. Each mode of communication and operation 

52 provided beneficial capabilities that might be further explored for future Human Spaceflight 

53 Missions to other solar system objects. We find that more frequent interactions between crews 

54 and an Apollo-style Science Team on the Earth best enables scientific progress during human 

55 exploration. However, during multiple vehicle missions, this communication with an Earth-based 

56 team of scientists, who represent “more minds on the problem”, should not come at the exclusion 

57 of (or significantly decrease) communication between the crewmembers in different vehicles 

58 who have the “eyes on the ground”. Inter-crew communications improved when discussions with 

59 a backroom were infrequent. Both aspects are critical and cannot be mutually exclusive. 

60 Increased vehicle separation distances best enable encounters with multiple geologic units. 

61 However, seemingly redundant visits by multiple vehicles to the same feature can be utilized to 

62 provide improved process-related observations about the development and modification of the 

63 local terrain. We consider the value of data management, transfer, and accessibility to be the 

64 most important lesson learned. Crews and backrooms should have access to all data and related 

65 interpretations within the mission in as close to real-time conditions as possible. This ensures 
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66 that while on another planetary surface, crewmembers are as educated as possible with respect to 

67 the observations and data they will need to collect at any moment. 

68 

69 1 . Introduction 

70 

71 Desert Research And Technology Studies (Desert RATS) is a multi-year series of tests of 

72 NASA hardware and operations deployed in the high desert of Arizona. Conducted annually 

73 since 1997, these activities exercise planetary surface hardware and operations in relatively harsh 

74 conditions where long-distance, multi-day roving traverses are achievable. Such activities not 

75 only test vehicle subsystems, they also stress communications and operations systems and enable 

76 testing of science operations approaches that advance human and robotic surface exploration 

77 capabilities as well as the ability to conduct scientific studies, including field geology. 

78 Desert RATS 2010 tested two crewed, electrically-powered rovers that were designed as first- 

79 generation prototypes of small pressurized vehicles. Each rover, or Space Exploration Vehicle 

80 (SEV) [1], provided the internal volume necessary for crewmembers to live and work for periods 

81 of at least 14 days, as was demonstrated during the 2009 field test [2], The SEVs also enable the 

82 crew to conduct extra vehicular activities (EVAs) through the use of rear-mounted suit ports [2, 

83 3], The 2010 test was designed to simulate geologic science traverses over a 14-day period 

84 through a volcanic field that is analogous to volcanic terrains observed throughout the Solar 

85 System. 

86 The test was conducted between 31 August and 13 September 2010 and is described in detail 

87 by Kosmo et al. in this issue [4]. Two crewmembers lived in and operated each rover for a week 

88 with a “shift change” on day 7, resulting in a total of eight test subjects for the two-week period. 

89 Each crew consisted of an engineer/commander and a field-experienced geologist. Three of the 
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90 crew commanders were experienced astronauts with at least one Space Shuttle flight. The field 

91 geologists were drawn from the scientific community, including NASA centers and academia, 

92 based on funded and published field expertise. As such, each rover crew was capable of 

93 providing feedback regarding the effect that different operational modes had on mission 

94 operations and science capabilities as compared to actual spaceflight missions and terrestrial 

95 field geology research. 

96 Here we present the opinions of Desert RATS geologist crewmembers on the effect that 

97 different operational modes had on our overall science productivity during the 2010 traverses. 

98 Unlike other papers presented in this Issue [1, 5,] our results are not quantified or based on 

99 metric analyses Instead, “science productivity” as discussed here is a qualitative assessment 

100 made by the authors from their perspective on working inside the SEV and while on EVA as 

101 compared to our regular field geology projects that support our career research. We note here 

102 that the authors reached a consensus regarding the points raised in this report. The goal of this 

103 report is to explain the way in which the crewmembers functioned based on varying the mode of 

104 communication and operation, and how each approach might be best utilized in similarly- 

105 designed future spaceflight missions. Differences in the approach to handling the operations and 

106 communications modes among the crews are discussed. Spaceflight constraints will always 

107 hinder planetary fieldwork when compared to traditional terrestrial field science, but our work 

108 strives to ensure that future spaceflight crewmembers are prepared to maximize their scientific 

109 efficiency within those constrained working conditions. 

110 

111 2. Methods 

112 
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113 The 2010 test explored different communications and operations modes that we briefly 

114 describe here. For a more detailed description of the modes tested during Desert RATS 2010 see 

115 Kosmos et ah, and Eppler et. ah, (both in this issue) [4, 6]. Three days of each week were tested 

116 with the rovers in continuous communications (CC) with mission operations and the science 

117 support teams. Another three days were tested with communications for only ~1 hour in the 

118 morning and ~1 hour at the end of the traverse, called twice-a-day communications (2/Day). 

119 During 2/Day, the SEVs were to remain generally within line-of-sight and in communication 

120 with each other. Constrained by these requirements, the separation distance was < 500 m. 

121 Using two SEVs also enabled the testing of two different operations modes (Figure 1). We 

122 tested an exploration strategy in which the two SEVs executed unique traverses, called divide- 

123 and-conquer (D&C). The second mode of operation had the rovers follow one another on the 

124 same traverse, called lead-and-follow (L&F). Each mode of operation was combined with a 

125 communication mode for the field test as discussed in the following section. Matrices were 

126 designed to measure the data quality and exploration productivity of each mode, generally 

127 finding that both improved during CC and D&C [1]. To complement those quantitative analyses, 

128 here we report the opinions of the geologist crewmembers as to which aspects of each mode 

129 were considered advantages and disadvantages in conducting science operations. 

130 

131 INSERT FIGURE 1 HERE 

132 

133 Within this report we use several terms for which we provide our intended meaning here. The 

134 Science Team and Science Backroom require distinction. The Science Team is everyone 

135 involved in the science of the Mission. This includes the scientists involved in the pre-Mission 
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136 science planning, as well as those who filled Science Backroom roles during the test and field 

137 scientists who observed the work of the crew during the test. The Science Backroom is a 

138 subgroup of the Science Team that is devoted to handling science operations for an SEV during a 

139 traverse. Each Science Backroom was led by a Science PI and included personnel dedicated to 

140 various aspects of the work that was underway by crewmembers. Most Science Team members 

141 cycled through different positions within a Science Backroom, as well as into field observations 

142 roles throughout the test. As such, the Mission and traverse planners were sometimes located 

143 within a Science Backroom, but were not always present in one or both backrooms. Each SEV 

144 had one dedicated Science Backroom during CC. 

145 We use the terms EVA, Station, drive, and traverse. An EVA is any situation in which one or 

146 both crew members have egressed, or exited, from the SEV through the suitport and are 

147 conducting science or rover maintenance tasks. A Station is a location, generally predetermined 

148 by the Science Team or the Mission Control Center (MCC), at which the SEV has stopped to 

149 conduct scientific observations or maintenance. A Station might or might not include an EVA. 

150 A drive involves a SEV moving between Stations. A traverse is a series of stations and drives. 

151 For example, a daily traverse might contain three Stations, while a crew’s complete seven-day 

152 traverse includes all Stations visited during their portion of the Mission. We also discuss 

153 prebriefings and debriefings, including those among the crews and those between crews and with 

154 the Science Backroom or MCC. A prebriefing is a meeting between relevant parties prior to an 

155 action, such as an EVA or the day’s overall activities. A debriefing is a similar meeting held 

156 after the activity is complete. When discussing both types of meetings in a general way we use 

157 the word “briefings”. Prebriefings and debriefings, and their purposes, are discussed in additional 

158 detail by Love and Bleacher [7] in this issue. 
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159 


160 3. Crew Daily Science Activities 

161 

162 The 2010 Desert RATS field campaign operated under two operations/communications mode 

163 combinations: D&C with CC; and L&F with 2/Day. The Mission was designed to assess each 

164 operation and communication mode independently, and no Mission-level goals included the 

165 assessment of paired modes. As such, we did not operate under each possible combination of 

166 operations and communications modes. The actual combinations were, in part, chosen for safety 

167 reasons because when not in communication with the MCC and Science Backroom the SEVs 

168 needed to be in close proximity for hazard and emergency mitigation, which essentially 

169 eliminated the possible combination of D&C and 2/Day. CC and L&F were not paired at any 

170 time during the 2010 field test. Although these test modes were assessed independently, we 

171 present our observations and conclusions in the paired format in which the field test was 

172 conducted. 

173 Within these modes of operation the science team and crew worked together to develop 

174 geologic hypotheses that could be tested with field observations that were enabled by the 

175 mobility of the SEV and EVA capabilities of the crew [8, 9]. The ultimate goal of the 2010 

176 Desert RATS field campaign was to identify ways to best preserve idealized - and, perhaps, 

177 “traditional” - terrestrial field capabilities within a constrained human spaceflight environment. 

178 In this section we describe the daily science activities within each combination of 

179 communications and operations modes. Each combination resulted in distinctive test outcomes, 

180 each of which would have unique relevance to different styles of missions and approaches to 

181 scientific data collection. For instance, missions to Mars or asteroids are unlikely to experience 
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182 CC, therefore preparation for dealing with delayed or limited communications is critical 

183 regardless of the operations mode that might selected. 

184 

185 3.1 Continuous Communications and Divide-and-Conquer 

186 Activities performed by an individual SEV crew and their Science Backroom during CC 

187 essentially adopted a strategy similar to that used by the 2009 crews and Science Backrooms [2, 

188 10]. During this portion of the test, the operations mode enabled the SEVs to spread out and 

189 cover more ground (Figure 1). This capability supported the exploration and collection of 

190 samples from a more diverse set of geologic units. Furthennore, CC enabled us to continuously 

191 work with a host of scientists in the backroom to develop, in real-time, hypotheses that might be 

192 testable within an ongoing EVA, traverse, or during the course of the entire mission [6], The 

193 Science Backroom worked continuously with MCC to maintain a balance between science 

194 objectives and changes to the daily timeline, in part, necessitated by delays during drives or 

195 EVAs and other operational constraints. Regular updates were provided to the crew regarding 

196 their timeline by the Science Backroom and MCC so that neither crewmember within an SEV 

197 was required to focus significant attention to changes in the timeline. Therefore the geologist 

198 crewmember, in particular, was free to focus on geologic descriptions during drives. The 

199 backroom was also able to provide support to the crew by indicating when the image data or 

200 sample description information was not adequate (e.g. poor sample placement within the image 

201 frame, the lack of specific information from a sample description, etc.), thereby enabling the 

202 crew to take corrective measures. This was particularly critical during EVAs in the 2010 test 

203 because the crews were unable to see the image and video data that they were collecting [11], 

204 Prior to the beginning of an EVA, each rover’s crew would hold a short prebriefing amongst 
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205 themselves to lay out a specific exploration and sample collection strategy for that site. During 

206 CC, the science support team was able to weigh in on this briefing, but, in general, gave the crew 

207 the final decision-making authority for specific Station parking spot selection and EVA plan 

208 development. This represents a lesson learned from the 2009 field test during which pre- 

209 acquired robotic rover data sometimes led to tension between the Science Backroom and crew. 

210 On occasion during the 2009 test, the Backroom questioned the real-time site selection and 

211 sample location decisions of the crew because of occasional discrepancies between the robotic 

212 reconnaissance data and what the crew was seeing real-time. During the 2010 field test, the 

213 Science Backroom had access to prior data collected from other sites, the geologic map, and, 

214 based on images acquired from a camera mounted on the SEV’s mast, a wider field of view than 

215 the crew. The Science Backroom could use these data as references to help direct an EVA, 

216 whereas the crew could not access any of those data in real-time while on EVA. CC also enabled 

217 the backroom to operate the SEV-mounted cameras during EVAs to document the surrounding 

218 terrain or keep track of the crew’s activities, including the collection of geologic observations 

219 and samples [12], 

220 Although we found communications with the Science Backroom to be beneficial, we did 

221 identity some drawbacks. To reduce the overlap in communications between two SEVs and their 

222 respective Science Backrooms, the Desert RATS team placed each SEV on a separate 

223 communications loop. Although the SEVs had a voice loop for communications between one 

224 another during drives or IVA (Internal Vehicular Activity) operations, it was not the default 

225 configuration. In practice, we found that communications between SEVs during the CC 

226 traverses were limited because it was logistically difficult to enable the communications link. 

227 Furthermore, in order to initiate communication with the other SEV during IVA, the crews were 
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228 required to ask permission from the MCC. For this reason, the geologist crewmembers never 

229 communicated between rovers during the week 1 CC days. During week 2, the geologist 

230 crewmembers did communicate during CC, but only rarely and informally. In addition, it was 

231 not possible, in either of the communications modes, for an IVA crew of one SEV to initiate 

232 communication with the other crew while the other crew was on EVA. Because EVA schedules 

233 often did not overlap, or changes in the timeline caused planned overlaps to become out of sync, 

234 significant periods of time were therefore essentially inter-SEV communication blackouts. As 

235 such, we describe inter-SEV communications during CC as difficult. We made up for this on- 

236 the-ground communications deficiency by holding unscheduled 30-60 minute SEV-to-SEV 

237 debriefs daily during crew personal time, typically at the end of the day. However, this approach 

238 negates the potential benefit of each crewmember’s complete awareness of the other’s 

239 observations and hypotheses in real-time, which would have been scientifically and operationally 

240 advantageous during daily activities, and completely eliminated the Science Backroom from the 

241 discussion. 

242 

243 3.2 Twice-a-Day Communications and Lead and Follow 

244 The 2/Day and L&F scenarios were new test variables for the DRATS field tests. During 

245 2/Day and L&F operations, the crew took on a significantly increased responsibility for timeline 

246 management. At the end of the morning prebriefings, the crews were told at what time that 

247 evening they were expected to reestablish communications with the MCC. Once the SEVs ended 

248 communication with the MCC, the crews were responsible for ensuring that the science 

249 objectives were met within the time available for that day’s traverse. The first step towards doing 

250 so was effective timeline management, which added to the crew workload as they did not have 
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251 MCC to manage this activity. Each SEV crew conducted timeline management independently as 

252 a means of redundancy, thereby enabling cross-checking between SEV crews for this important 

253 activity. If time was lost along the day’s traverse, the crews were responsible for detennining in 

254 real-time how best to preserve the rest of the day’s science objectives within the shortened 

255 timeline. This task included decisions in which lower priority science objectives were dropped to 

256 ensure that higher priority objectives could be met. To help minimize the added responsibility 

257 on the crews during 2/Day, the morning Science Team prebriefs evolved throughout the 2010 

258 field test to include a detailed prioritized list of Station objectives. This helped decrease crew 

259 time spent adjusting the daily science plan to the evolving timeline. During the second week of 

260 the test, the Science Team prebriefs continued to evolve to include a “big picture” science 

261 overview that linked the day’s objectives to the observations and lessons learned throughout the 

262 previously completed traverse days. This development provided the crews with some context to 

263 better judge the importance of previously prioritized tasks, and this improved our real-time 

264 decision making capabilities. 

265 Because 2/Day communications limited the interactions between the SEV crews and the 

266 Science Team and MCC, the daily activities of the crews were not closely monitored [6]. 

267 Furthermore, because the week 1 crews did not provide an operational debrief to the week 2 

268 crews, neither week’s crewmembers had a preconception as to how to conduct their 2/Day and 

269 L&F operations within the Flight Rule constraints [6], As such, during 2/Day and L&F 

270 operations each week’s crews developed a unique approach to conducting a traverse under these 

271 conditions. Those differences, as well as their unique strengths, are outlined in the following 

272 paragraphs. As is the theme throughout this report, we show that each approach holds 

273 advantages that should be preserved in future operations tests and Space Flight Missions. 
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274 In general, L&F operations kept the SEVs within line-of-sight and rarely exceeded 500 m of 

275 separation. Although the phrase Lead and Follow suggests that the SEVs would operate in close 

276 proximity at all times, the stations that were planned for each crew by the Science Team were 

277 often several hundred meters apart. As such, the crews for each pair of SEVs developed their 

278 own strategy for working together both during drives and at Stations. The primary differences 

279 between the week 1 and week 2 strategies were associated with real-time Station selection and 

280 drives between them. Week 1 crews conducted all of their drives in a closely spaced formation, 

281 but separated to farther extents during Station selection without necessarily attempting to reach 

282 the specified site that was planned by the Science Team. Week 2 crews conducted their drives in 

283 a less strict spatial formation but attempted to reach the Station sites that were planned for them. 

284 During CC the crews received continual input from the Science Backroom regarding Station 

285 selection and drive locations, but during 2/Day and L&F the crews depended on each other to 

286 make those decisions. Despite these differences within L&F, both crews operated within the 

287 constraints that were designed for the field test during L&F operations. These differences 

288 highlight the importance of field tests as these unique styles enable unique capabilities that are 

289 not necessarily easily planned from an office. 

290 During week 1, the SEVs remained relatively close to one another during L&F drives 

291 generally a few 10s of meters apart (Figure 1). Upon nearing a Station, the SEV crews would 

292 discuss the best sampling and site selection strategy. Because week 1 crews always drove in 

293 close formation this usually involved reaching a point between the Stations that were planned by 

294 the Science Team (often 200-300 m separation). The SEVs would then split off towards their 

295 respective Stations while conducting regular radio checks to ensure that communications were 

296 maintained. At a given Station, the crew with the highest priority objective usually chose a 
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297 parking location first that enabled them to address that goal, and the crew with lower priority 

298 objectives would select a parking spot that maintained communication with the other SEV but 

299 provided the opportunity to conduct the most effective field work. If the geologist crewmembers 

300 believed that they would likely sample the same material, and either crew could identify an 

301 alternative Station nearby that would enable sampling of an unexplored unit that was 

302 unrecognized by prior analysis of remote sensing data, then the lower priority tasks were 

303 dropped and a real-time decision was made to explore the new unit (see Hurtado et al. [12] this 

304 issue for more details on geologic fieldwork strategies during EVAs). Prior to the first crew’s 

305 start of an EVA, both SEV crews would determine at what time their ingress into the SEV at the 

306 end of their EVA should begin such that both SEVs could meet at an agreed upon rendezvous 

307 point at the same time to begin the next drive in close formation. In other words, crew agreement 

308 upon the time for ingress initiation was a critical decision point during week 1 . If the geologists 

309 determined that a site that was different from the one selected by the Science Team was to be 

310 explored, then their crew was responsible for ensuring that their ingress after EVA began at the 

311 time necessary to accommodate the SEV rendezvous. This approach always kept the SEVs 

312 within a few 10s of meters during a drive, which had some advantages as described below. We 

313 refer to this L&F tactic as “Paired Exploration”. 

314 During week 2 the crews generally adopted a strategy in which the SEVs attempted to park at 

315 or near the predetermined Station locations (in as much as was safely and logistically possible, 

316 similar to selecting a parking spot during D&C). The week 2 crews also held prebriefings to 

317 determine EVA durations and ingress times, but were less regimented in identifying a post-EVA 

318 rendezvous point and time. Because neither SEV was expected to wait for the other at a 

319 rendezvous point before the drive to the next station, this approach enabled the SEVs to travel at 
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320 a separation distance of up to -100 meters opposed to -10-40 meters as was typical of the Paired 

321 Exploration strategy utilized in week 1. As such, week 2 crews took less authority to choose a 

322 specific parking location unique from the traverse plan, but did spread out during drives enabling 

323 unique observations from each crew. We tentatively refer to week 2 crews L&F tactic as “Recon 

324 Exploration”, and it had unique advantages as described below. 

325 Regardless of the Exploration style they used, Paired or Recon, the crews were always in 

326 close enough proximity to provide situational awareness feedback to each other. This was 

327 advantageous when crossing rough terrain, such as gullies, during which the SEV in front could 

328 find the safest path and relay that information to the trailing SEV. Similarly, the trailing SEV 

329 could reach higher ground and provide descriptions of the path ahead to the lead SEV to help 

330 them select a path. This was done nearly continuously as the geologist crew members discussed 

331 the geology and the crew commanders discussed how to traverse across it. 

332 The crews worked together during IVA operations on the L&F traverses to acquire data that 

333 was complementary and did not repeat observations at a station. During CC and D&C 

334 operations, a SEV crew would sometimes collect Crew Field Notes (CFNs) [11, 12], typically 

335 consisting of a single image from a camera mounted on the SEV’s mast and a recorded voice 

336 note. Since the SEVs were at different Stations during D&C, each crew’s CFNs and Panoramic 

337 images were unique, and crews had to spend time acquiring both sets of data, or only acquire one 

338 data type. During 2/Day and L&F Paired Exploration operations, the SEV crews worked in 

339 concert such that one SEV crew would collect a CFN at a stop while the other SEV further 

340 documented the area with a GigaPan (self stitching panorama from a second camera mounted on 

341 the SEV mast) [13] that was simultaneously acquired and included the SEV that was collecting a 

342 CFN image of a smaller scale feature. This style of complementary IVA data collection provided 


15 



343 improved geologic context for CFN data, as opposed to a single CFN or GigaPan image acquired 

344 by a solitary SEV. This adaptation was a logical step as the collection of a CFN by one SEV 

345 essentially forced the other SEV to stop and wait during Paired Exploration, and this potentially 

346 wasted idle time was put to good use. 

347 During Recon Exploration, the SEV crews did not wait for each other, either at a rendezvous 

348 point or during CFN image acquisition. As such, potentially wasted waiting time was minimized 

349 or eliminated entirely. In situations when one crew completed their EVA earlier than their 

350 partners, the first crew pressed forward on the traverse. Although this style of exploration never 

351 resulted in significant separation, and the crews were not operating independently of one another, 

352 this enabled the lead crew to scout out or recon the best path for the following SEV’s drive or 

353 sites for image acquisition. As such, the first SEV crew was able to provide advice on pathway 

354 and parking spot selection. However, in cases when the SEVs during week 2 were separated by 

355 greater distances than during week 1, the local, precise situational awareness enabled by Paired 

356 Exploration was reduced when crossing difficult terrain. Greater separation distances also 

357 prohibited the Recon Exploration crews from acquiring complementary CFN and GigaPan data. 

358 However, it is not clear how advantageous these data were/are to the Science Team. Perhaps not 

359 all CFNs would experience an increase in value when complemented with a GigaPan. This 

360 represents a possible trade study for future tests in which L&F operations are considered. These 

361 differences only recently came to light, due to the preparation of this report, and, as such, are still 

362 being considered by the Science Team. This point demonstrates the importance of preparing 

363 reports such as those in this Special Issue to help draw out possibly overlooked real-time test 

364 adaptations and outcomes. 

365 As mentioned above, L&F operations, regardless of Paired or Recon Exploration approaches, 
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366 often led to repetitive sampling of the same geologic units as the traverse Stations regularly 

367 restricted the crew to the same area. This could be viewed, albeit problematically, as a 

368 disadvantage in that we covered less ground and explored fewer units [12]. Conversely we found 

369 that while working with the other SEV we were able to conduct more detailed process-related 

370 observations. An example involved a gully that had eroded into the base of a cone (Figure 2). 

371 

372 [INSERT FIGURE 2 HERE] 

373 

374 During EVA both crews crossed the gully at ~ 300 m separation and were able to determine the 

375 amount of incision and gully widening over that distance. A stop at the same location during 

376 D&C would have collected one set of the same samples and observations, but may have provided 

377 little input on the erosion process other than that it had occurred. 

378 During 2/Day we communicated nearly continuously between SEVs. Although CC interaction 

379 with a backroom enabled more experienced minds to work on a science problem, having two sets 

380 of trained eyes on the same terrain also proved advantageous. During both Paired and Recon 

381 Exploration, the crew geologists were able to discuss their observations and hypotheses 

382 throughout the traverse. This enabled the crew to quickly compare results, both prior to and after 

383 EVAs, enabling improved Station selection and EVA planning. This sort of real-time traverse 

384 refinement informed by first-hand analysis in the field is not possible with a remote science team 

385 and was a benefit to executing efficient and scientifically effective EVAs. Similarly, the two 

386 geologists could, when practical on L&F days, convene on the outcrop during EVAs in order to 

387 compare samples and observations. This was an effective way of synthesizing geologic 

388 understanding while still in a position to make additional observations. Having communicated 
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389 throughout the day’s traverse reduced the amount of time spent discussing work during crew 

390 personal time at the end of the day. However, during 2/Day we found that the scheduled ~60 min 

391 science debriefs at the end of the day were not adequate to convey our daily observations and 

392 hypotheses to the science team. This could essentially represent a loss of data between crew and 

393 backroom at some points, particularly if there are bottlenecks or points-of-failure in the 

394 automated transfer of digital files between the SEV and Science Team. This highlights the need 

395 for effective data flow between all parties. Regardless of operation or communication mode, we 

396 collected annotated GigaPan images, maintained spreadsheets, and documented the traverse with 

397 text documents from inside the SEV [ 12 ]. However, it was not always clear to us which of these 

398 files were transferred, received, and analyzed by the Science Team prior to each morning’s 

399 prebrief. 

400 

401 4. Findings and Recommendations 

402 

403 The 2010 Desert RATS field test essentially represents a set of “end-member” communication 

404 and operational modes that could be used during dual rover planetary exploration. In the 

405 preceding section we discussed differences in the daily science operations within the SEVs 

406 during the traverse. Both operations and communications modalities pose advantages and 

407 disadvantages to the geologist crewmembers and their ability to collect scientific data. Based on 

408 the geologist crewmembers’ experiences managing these challenges, we present 

409 recommendations for how to maximize the science capabilities of future surface exploration 

410 missions that might utilize some variants of these end-member cases. We note that despite the 

411 limitations of a given operations or communications mode, the crew, Science Team, and MCC 
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412 adapted quickly to best exploit the advantages present within the operations test. We believe this 

413 to be consistent with all human spaceflight endeavors, and it highlights the necessity of realistic 

414 analog tests and training prior to Mission activities. No lesson learned during an analog test is 

415 insignificant. Any experience-based method for streamlining the adaptation pathway towards 

416 maximizing the value of science or mission operations activities within a given set of limitations 

417 is highly valuable, even if it is not realized for years or even decades. 

418 It is important to recognize that the crew is but one portion of the Science Team. The ultimate 

419 science goal of any mission is to provide the most thorough scientific understanding possible of 

420 an area of exploration. In the case of Apollo, much of this overall understanding was not 

421 achieved for years to decades afterwards [14], and continues to this day. As such, the goal is not 

422 necessarily that the crew themselves gain that understanding in real-time, but that they work with 

423 the Science Team to collect the most important data to enable both real-time and continued 

424 science in the years to follow. After all, the hypothesis development that drives scientific 

425 advances does not end with the mission. However, to ensure that the correct data are acquired, 

426 the crew must be involved in hypothesis development and have as clear an understanding of the 

427 overall science as everyone else on the Science Team. 

428 With this in mind, the geology crewmembers generally agree that a better overall scientific 

429 understanding of the 2010 test region was ultimately gained during CC and D&C. When the 

430 Science Team was given time to ingest and compare results from both rovers over a larger area 

431 of exploration, a more complete scientific story resulted. However, we also felt that we had a 

432 better personal recognition of the larger science story in real-time when we communicated with 

433 our partner SEV’s crew regularly during 2/Day activities. This point is discussed by Litaker and 

434 Howard (this issue) [5] based on metric data analysis of the crew’s experience. They state: 
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435 “Interestingly, during debrief sessions; (sic) the crew reported in 2/Day they had a better 

436 understanding of the bigger scientific picture than in CC due to the communications between the 

437 science members of the crew.” Consistent with our discussion above, we clarify this point here 

438 by stating that, with respect to communications, we found value in real-time access to the 

439 knowledge gained by the other crew geologist. However, while this led to an improved personal 

440 understanding of the regional science, ultimately the overall science understanding gained during 

441 the mission was best maximized during CC with additional scientists in the backroom. 

442 Furthermore, potential loss of data during 2/Day was a genuine risk as the crew were not able to 

443 update the Science Backroom about their thoughts and observations in real-time. As such, data 

444 could be truly lost in this communications mode. This point highlights the importance of 

445 ensuring that the crew are kept, as best as possible, in the loop regarding hypothesis and science 

446 story development including data from both SEVs during the daily pre- and debriefs. We also 

447 reiterate that the Science Team was aware of this issue throughout the 2010 test as evidenced by 

448 the continually improving briefing strategies outlined in Section 3.2. This point also clearly 

449 demonstrates that both end-member communications modes hold some value that might be 

450 usefully incorporated into future Space Flight Missions. We discuss this point further in the 

451 following paragraphs. 

452 We note here that, although the test included a CC scenario, at no point did we truly 

453 experience continuous communications with MCC or the Science Backroom due to difficulties in 

454 deploying test assets to maintain communications in a terrain with significant relief. We found it 

455 easier to operate when planning for intermittent communications than to expect CC but, in 

456 reality, experience intermittent communications. As a result, we recommend that a series of 

457 fallback communications protocols should be established to deal with loss of signal situations, 
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458 particularly because continuous communication is not likely to exist for a mission to most 

459 planetary surfaces. During CC in week 2, the SEVs crew did begin creating a form of fallback 

460 plan by discussing the goals of the upcoming EVA during each EVA debrief. This turned out to 

461 be useful in one instance where the crew lost communications with their Science Backroom prior 

462 to arriving at a Station, the exact time when the prebrief would typically have been underway. 

463 Based on the communications tests we feel that the best overall science was achieved when 

464 more brains were working on the science problems. Ideally we prefer regular communications 

465 with a Science Backroom to help develop competing hypotheses and tests to differentiate 

466 between them. When not in regular communications with a Science Backroom, the crew relied 

467 heavily upon inter-SEV discussions to increase the value of our science results as compared to 

468 working in complete isolation. However, even if near-continuous communications with the 

469 Science Backroom are achievable, we still recommend that the crews should be provided time in 

470 the schedule to communicate among each other during a traverse. Perhaps this will require 

471 developments in communications infrastructure to enable multiple loops that allow simultaneous 

472 communications without interference. Lacking such a development, the MCC and Science Team 

473 must understand that this type of inter-crew communication is mission critical, and not an action 

474 to be occasionally accommodated. As mentioned earlier, having multiple personnel working in 

475 the Science Backroom is beneficial, but so is having a second set of eyes on the ground and a 

476 resultant increased contextual understanding of the area of exploration. Neither completely 

477 replaces the value of the other and the advantages of both should be preserved even when 

478 operating in near-continuous communications with a Science Team. 

479 To ensure flow of information between rovers (and their Science Backrooms) the concept of a 

480 single Mission Science Principal Investigator (PI), with oversight of both SEV teams (crews and 
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481 Science Backrooms), should be explored. During the 2010 test, the Science Backrooms were 

482 located in adjacent rooms, but science communications between them were informal and 

483 sporadic [6]. During CC, our communications between SEV crews were also minimized so as 

484 not to interfere with EVAs or ongoing discussions between the other crew and their Science 

485 Backroom. The Mission Science PI would be responsible for developing the overall science 

486 story for the mission so that neither SEV team is working in isolation as a consequence of trying 

487 to reduce the impact of too many voices speaking simultaneously on communications loops. 

488 During this test, the data collected while on EVA [12], including imagery, video, and voice, 

489 were generally not available to the crews for review. Young et al. (this issue) [11] recommends 

490 that, at the very least, crew members should be able to monitor their camera status in real-time, 

491 which is a capability that has already been added for the 2011 Desert RATS field test. Here we 

492 additionally recommend that all data should be available between SEV crews, and ultimately 

493 between EVA crewmembers in real-time. Regardless of data display and sharing capabilities, 

494 the Mission Science PI would ensure that all crew and Science Backroom participants are aware 

495 of relevant observations from their counterparts throughout the traverse, and that neither team is 

496 working in isolation. 

497 In addition to a Mission Science PI, we recommend that a geology-trained crewmember 

498 should be identified as a Field Science PI in much the same way that an overall Crew 

499 Commander is identified between the SEVs. The Field Science PI should have final decision- 

500 making authority on the ground. The Field Science PI would be most important when 

501 communications are limited to several times per day opposed to CC. Although we did not 

502 encounter a problem in this aspect of the test during 2/Day, it is obvious that somebody should 

503 have overall science decision-making authority on the ground, particularly when the crew are 
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504 responsible for maintaining their own timeline and when Stations and EVA plans might need to 

505 be modified or dropped entirely. 

506 We feel that the daily science debriefs during 2/Day did not enable us to adequately convey 

507 our scientific lessons learned from the day’s traverse, thereby limiting the overall science learned 

508 during the mission. This point highlights the importance of science debriefs during limited 

509 communications situations between the crew and Science Backroom. The format of this 

510 discussion was not well developed prior to the field test and evolved as the test progressed, but 

511 we suggest that it should be significantly structured so that the crew can easily, succinctly, and 

512 completely convey the important aspects of their day’s traverse. Additionally, the point of 

513 contact that represents the Science Backroom to the crew should remain consistent and have a 

514 strong working knowledge of the day’s activities and results. One possibility would be that the 

515 science debrief is led by the Field Science PI. That individual would synthesize and summarize 

516 both SEV’s results prior to the meeting and then present this to the Mission Science PI during the 

517 briefing itself, as opposed to each geologist crewmember discussing their own, possibly 

518 redundant, observations. Furthermore, if real-time interactions are possible during briefings it 

519 would be beneficial if the crew and Science Team could interactively view and annotate the 

520 same data. 

521 In order to maximize the efficiency of the daily prebriefs and debriefs, the data flow 

522 framework must be clearly understood between the SEVs and their Science Backrooms. This 

523 was particularly important during 2/D. The crew often created what was essentially a science 

524 abstract for the day’s traverse, including new hypotheses and answers to questions that had been 

525 raised by the science team in the morning prebrief. However, sometimes this information was not 

526 received by the backroom due to uncertainty as to where digital data was to be stored in the SEV 
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527 computer system for upload/download and a lack of a mechanism for explicitly indicating if and 

528 when those data were transferred. In these instances, confusion arose between the crew and their 

529 Science Backrooms because it was not clear which data had been transferred and particularly 

530 which data had been included in briefing discussions. As such, we recommend that science 

531 prebriefings should always indicate what data were used in the development of that presentation. 

532 Furthermore, a standard set of daily data products should be expected and documentation should 

533 be kept to indicate where those data should reside and when those data have or have not been 

534 transferred. To address these issues, a dedicated data manager position with data transfer 

535 oversight should exist on the Science Team. We also reiterate here the point that data should also 

536 be easily transferrable between the SEVs and that the crews should have access to all the data 

537 that they have collected throughout their traverse, something that was not possible during Desert 

538 RATS 2010. 

539 Early in the test, the morning science briefings focused heavily on sample collection 

540 objectives. As the test progressed, the morning science briefings began providing us with the 

541 geologic hypotheses that drove the sample requirements. Inclusion of the crew in the hypothesis 

542 development and data collection planning process is critical for maintaining the crew’s focus on 

543 science goals. Although the Science PI (a position that existed within each Science Backroom 

544 during the 2010 test, such that each SEV had a Science PI) was located with the Science Team, 

545 the crews were the eyes on the ground. Providing the crews with the current hypotheses and 

546 tests (samples, observations, and other data) to differentiate between them ensures that the goals 

547 of the Science PI will be met. This is an interaction between the crews and their Science 

548 Backrooms that did improve throughout the traverse regardless of operating or communication 

549 mode. However, during CC the backroom was capable of updating the crew in real-time about 
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550 hypothesis development, whereas during 2/Day the crew were solely responsible for real-time 

551 hypothesis development and testing, and as such the Science Team were updated twice-per-day. 

552 As such, the importance of the daily science prebrief increases dramatically when 

553 communication opportunities decrease within a given mission day, and the structure of the 

554 prebrief might be fundamentally different depending on the frequency of communications during 

555 the day and the length of time available during the meeting. 

556 Regardless of the operations mode for a mission, traverse design is a critical component as the 

557 traverse is essentially the scientific backbone upon which the mission is built. As such, traverse 

558 design should be led by a PI who will be in the Science Backroom during its execution, 

559 potentially occupying the role of Mission Science PI as discussed above. It is critical that this 

560 person have an intimate understanding of the traverse for real-time decision making for both 

561 rovers based on the collection of new data. Furthermore, it is critical that the crew and the daily 

562 brief/debrief leads also possess an intimate understanding of the daily traverse plans, which is 

563 most easily established through involvement in traverse plan development. 

564 

565 5. Conclusions 

566 

567 Many Solar System targets have been identified for possible human exploration missions in 

568 the future, and these choices are based on numerous scientific rationales. Regardless of the 

569 destinations that are chosen, the humans who explore these locations will be faced with many 

570 operational constraints on their ability to conduct scientific analyses. Although science will be a 

571 significant driver of future human exploration, safety concerns and physical limitations will 

572 largely control the frequency and duration of delays in communications between crews and 
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573 supporting scientists back on Earth. This will also determine the allowable separation distances 

574 between assets and the mode of operation among multiple spacecraft assets, both robotic and 

575 crewed. As such, we do not suggest that any of the modes of operation tested during Desert 

576 RATS 2010 is an obvious better option, as it is not clear what the cost of those capabilities might 

577 be that could offset their potential advantage. All modes that were tested in the 2010 Desert 

578 RATS field campaign revealed limitations in our capabilities as field geologists when compared 

579 to the standard terrestrial fieldwork with which we are most accustomed. However, each mode 

580 of operation that was tested did provide unique advantages. Our goal is to highlight those 

581 advantages so that when technological constraints are placed on future human explorers, they are 

582 mitigated using an approach that maximizes scientific efficiency within that architecture. 

583 We find that regular communications between the crews and their supporting scientists 

584 enables the most effective real-time hypothesis development and testing throughout a traverse. 

585 However, the communication infrastructure established for the 2010 test did not enable adequate 

586 communication between crews, an equally critical capability to have. When communications 

587 with the Science Backroom were infrequent, the crews relied heavily upon each other for real- 

588 time hypothesis development. As such, both communications modes that were tested in 2010 

589 lead us to conclude that communications with a backroom on a regular basis are important, but 

590 that discussions between geology-trained crewmembers should not be lost in order to achieve 

591 this capability. Having more minds working on the problem is important, but so are discussions 

592 between those who have the eyes on the ground. Both are important and should not be mutually 

593 exclusive. In fact, we argue that they are likely mutually advantageous. 

594 Different separation distance between crews and rovers can enable unique and beneficial 

595 capabilities. Larger separation distances between rovers during a dual (or more) vehicle mission 
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596 enables the crews to spread out and cover more ground. This capability provides opportunities 

597 for crews to encounter, explore, and sample a more diverse set of geologic units, thereby 

598 exposing the science team to a broader, more regional understanding of the exploration target. 

599 Although a decreased separation distance might reduce the likelihood of the mission 

600 encountering different geologic units, closer proximity observations at times during the 2010 test 

601 provided higher detail process-related understandings of the local geology. 

602 Regardless of the mode of operations and communications, the need for competent data 

603 management, transfer, and accessibility in real-time is consistently a lesson learned. Multiple- 

604 rover missions require data sharing capabilities between the crews, encompassing quantified 

605 measurements, sample information, observations, and hypothesis development. In situations 

606 where multiple vehicles will each have a dedicated Science Backroom it is critical that one 

607 person on the mission’s Science Team be responsible for integrating each rover’s data and 

608 interpretations into the overall science story. Furthermore, that story must always be shared with 

609 the crews who might not have had a chance to fully recognize the value of the other crew’s 

610 observations during a traverse. An observation or sample from one rover might be the critical 

611 piece of information that drives an important realization by the other rover. 

612 Analog tests, such as the Desert RATS 2010 field campaign, represent the opportunity to 

613 collect critical operational data related to potential future solar system exploration missions. 

614 Although no analog test can fully capture the specific and complex set of architectural 

615 constraints that will eventually face the humans who explore other planets, satellites, or 

616 asteroids, we can begin to outline the methods in which we might best work within those likely 

617 constraints. Even more important is the identification of unrecognized difficulties so that we 

618 might begin incorporating them into future analog tests. In this context, we conclude that the 


27 



619 2010 test was a success, but is just one step in a series of many that are needed in the future to 

620 best enable human exploration of our solar system. 
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683 Figure Captions 

684 

685 Figure 1. The top image shows a portion of the San Francisco Volcanic Field, including S P 

686 Crater and Colton Crater (data product credited to Google). This region was the site for the 2010 

687 Desert RATS field test. The dashed line denotes the extent of the images at the bottom left and 

688 right. The panels labeled D&C and L&F show the same areas. The colored lines show the 

689 traverse paths followed by SEV A (red line) and SEV B (blue line) during different operations 

690 modes. The lines are based on the GPS navigational data collected by the SEVs during their 

691 traverses. D&C data were collected on 9/1/2010 by the week 1 crews and L&F data were 

692 collected on 9/12/2010 by the week 2 crews. 

693 

694 Figure 2. Images A and B are example still images that were acquired as CFNs (Crew Field 

695 Notes) using the crewmembers’ backpack cameras during 2/Day EVAs [12] within L&F 

696 operations. These images were obtained at the locations marked A and B on the map at the 

697 bottom of the figure. The orange and red lines show the rover paths for SEV A and SEV B, 

698 respectively. The green and blue lines show the EVA paths for the geologist crewmembers from 

699 SEV A and SEV B, respectively. The dashed black line shows the trend of a small gully that has 

700 formed at the base of a cinder cone. Although the primary science objectives at this location 

701 were to collect samples of the cone and the loosely consolidated surface materials around it, 

702 analysis of the CFN data shows that the gully dimensions vary from ~ 2 m wide and 10-30 cm 

703 deep at point B to ~ 3 m wide and 1 m deep at point A. This type of process-related, 

704 observational data contributes to the science value of a Station [13]. However, we note the 

705 potential difficulties in estimating scale from context images of the local geology (A). Unlike 
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706 traditional field work, it is not always easy to deploy a physical item for scale at some distance 

707 from the site at which the crew acquire images of the local geology. These data were acquired on 

708 9/4/2010. 

709 
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